arXiv:1503.05044vl [math.AP] 17 Mar 2015 


Manuscript submitted to 
AIMS’ Journals 

Volume X, Number OX, XX 200X 


doi:10.3934/xx.xx.xx.xx 


pp. X-XX 


ON THE SYSTEM OF PARTIAL DIFFERENTIAL EQUATIONS 
ARISING IN MEAN FIELD TYPE CONTROL 


Abstract. We discuss the system of Fokker-Planck and Hamilton-Jacobi- 
Bellman equations arising from the finite horizon control of McKean-Vlasov 
dynamics. We give examples of existence and uniqueness results. Finally, we 
propose some simple models for the motion of pedestrians and report about 
numerical simulations in which we compare mean filed games and mean field 
type control. 
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1. Introduction. In the recent years, an important research activity has been de¬ 
voted to the study of stochastic differential games with a large number of players. 
In their pioneering articles [ni[Ta[T3], J-M. Lasry and P-L. Lions have introduced 
the notion of mean field games, which describe the asymptotic behavior of sto¬ 
chastic differential games (Nash equilibria) as the number N of players tends to 
infinity. In these models, it is assumed that the agents are all identical and that 
an individual agent can hardly influence the outcome of the game. Moreover, each 
individual strategy is influenced by some averages of functions of the states of the 
other agents. In the limit when N -l-oo, a given agent feels the presence of the 
other agents through the statistical distribution of the states of the other players. 
Since perturbations of a single agent’s strategy does not influence the statistical 
distribution of the states, the latter acts as a parameter in the control problem to 
be solved by each agent. 

Another kind of asymptotic regime is obtained by assuming that all the agents use 
the same distributed feedback strategy and by passing to the limit as iV —>• oo 
before optimizing the common feedback. Given a common feedback strategy, the 
asymptotics are given by the McKean-Vlasov theory, [isiiin] : the dynamics of a 
given agent is found by solving a stochastic differential equation with coefficients 
depending on a mean field, namely the statistical distribution of the states, which 
may also affect the objective function. Since the feedback strategy is common to 
all agents, perturbations of the latter affect the mean field. Then, having each 
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player optimize its objective function amounts to solving a control problem driven 
by the McKean-Vlasov dynamics. The latter is named control of McKean-Vlasov 
dynamics by R. Carmona and F. Delarue El 13 and mean held type control by A. 
Bensoussan et al, HE]. 

When the dynamics of the players are independent stochastic processes, both mean 
held games and control of McKean-Vlasov dynamics naturally lead to a coupled sys¬ 
tem of partial differential equations, a forward Fokker-Planck equation (which may 
be named FP equation in the sequel) and a backward Hamilton-Jacobi-Bellman 
equation (which may be named HJB equation). For mean held games, the cou¬ 
pled system of partial differential equations has been studied by Lasry and Lions in 
[niiniiia]. Besides, many important aspects of the mathematical theory developed 
by J-M. Lasry and P-L. Lions on MFC are not published in journals or books, but 
can be found in the videos of the lectures of P-L. Lions at College de France: see 
the web site of College de France, [15]. One can also see |9] for a brief survey. 

In the present paper, we aim at studying the system of partial differential equations 
arising in mean held type control, when the horizon of the control problem is hnite: 
we will discuss the existence and the uniqueness of classical solutions. In the last 
paragraph of the paper, we briehy discuss some numerical simulations in the con¬ 
text of motion of pedestrians, and we compare the results obtained with mean held 
games and with mean held type control. 

1.1. Model and assumptions. For simplicity, we assume that all the functions 
used below (except in § H are periodic with respect to the state variables Xi^ i = 
l,...,d, of period 1 for example. This will save technical arguments on either 
problems in unbounded domains or boundary conditions. We denote by T'^ the 
d—dimensional unit torus: T'^ = Let P be the set of probability measures on 

and P DL^ (T'^) be the set of probability measures which are absolutely continuous 
with respect to the Lebesgue measure. For m G PnL^(T'^), the density of m with 
respect to the Lebesgue measure will be still be noted m, i.e. dm(x) = m(x)dx. 

Let g be a map from P to a subset of C^(T‘^ x R"; R.*^) ( the image of m G P will be 
noted g[m\ G C^(T^ x R"';R‘^) ) such that 

• there exists a constant M such that for all m G P and x G T”*, |(;[m](a:, 0)| < M 

• there exists a constant L such that 

— for all m G P, a G R" and x,y G T"^, \g[m]{x,a) — g[m]{y,a)\ < Ld{x,y) 
where d{x,y) is the distance between x and y in 

— for all m G P, a, 6 G R" and x G \g[m]{x, a) — g[m]{x, 6)| < L\a — b\ 

— for all m,m' G P, a G R" and x G \g[m\{x,a) — g[m']{x,a)\ < 
Ld 2 (rn,m') where d 2 is the Wasserstein distance: 

d 2 {m,m')= inf ( / d?{x,y)d'^{x,y)\ , 

7er(m,m') J 

r(m,m^) = ^7 : transport plan between m and 

and a transport plan 7 between m and m' is a Borel probability measure 
on X such that, for all Borel subset E of T'^, 

"f{E X T'^) = m{E) and 7 (T'^ x E) = m'{E). 

• there exists a map g from L^(T'^) to C^(T'^ x R"';R‘^) such that g|pnLi(T‘*) = 
dlpniqT'i) s-nd that for any a; G and a G R”, m —>■ g[m]{x,a) is Frechet 
differentiable in L^(T'^) and (a:,a) 1 —>■ ^[m](a;,a) belongs to 
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C^(T‘^ X K"; Hereafter, we will not make the distinction between 

g and g. 

Consider a probability space (H, A, V) and a filtration F* generated by a d-dimensional 
standard Wiener process {Wt) and the stochastic process (^t)ie[o,T] in adapted 
to which solves the stochastic differential equation 

dXt = g[mt]{Xt,at)dt + V^dWt VtG[0,r], (1.1) 

given the initial state Xq which is a random variable J^*^-measurable whose proba¬ 
bility density is noted mg. In 1 / is a positive number, rrit is the probability 

distribution of Xt and at is the control which we take to be 


at = v{t,Xt), (1.2) 

where is a continuous function on T'^. To the pair (u,m), we associate the 

objective 


J{v,m) :=1E 


f[mt]{Xt, at)dt + h[mT\{XT) 


(1.3) 


where / (resp. h) is a map from P to a subset of C^(T'^ x R"), resp. to a subset of 
C^(T‘^). We assume that 

• limiaKoo infmeP.^.eT'i = +oo 

• there exists a map / from L^(T'^) to C^(T‘^ x R") such that /|pni,i(T<i) = 
/IrnLqT'i) s-nd that for any a: G T'* and a G R", m —>■ /[m](a;, a) is Frechet dif¬ 
ferentiable in L^(T'^) and (x,a) >->• ^[TO](a;,a) belongs toC^(T'^xR"; L°“(T'^)). 
Hereafter, we will not make the distinction between / and /. 

We also assume that there exists a map h from T^(T‘^) to C^(T‘^) such that d|ppi^i(T<i) = 
^lpnLi(T'i) and that for any x G m —>■ h[m]{x) is Frechet differentiable in L^(T'^) 

and X !->■ ^[m](a;) belongs to C^(T‘^; T°°(T'^)). Hereafter, we will not make the dis¬ 
tinction between h and h. 

It will be useful to define the Lagrangian and Hamiltonian as follows: for any x G T”*, 
a G R” and p G R^*, 


L[m]{x,a,p) := f[m]{x,a)+p- g[m]{x,a) 
H[m][x,p) := min L[to](x, a,p). 


where p ■ q denotes the scalar product in R'^. 

It is consistent with the previous assumptions to suppose that 

• there exists a map H from i^(T'^) to C(T'^ x R'^) such that iF|pnLi(T‘^) = 
H\pnL^{T<^) and that for any x G andp G R'^, m — H[m]{x,p) is Frechet dif¬ 
ferentiable in L^(T'^) and (x,p) >->■ |^[m](x,p) belongs to C^(T‘*xR‘^; L°°(T'^)). 
We will not make the distinction between H and H. 

• if m G PnT^(T'^) and a* = argmin^/[m](x,a) +p- g[m]{x,a), then 


dH, , df . dg . _ 

= ^{x,a )+p- ^{x,a ). 

am om om 


As explained in [^, page 13, if the feedback function v is smooth enough and 
if mo G PnL^(T'^), then the probability distribution m„(t, •) has a density with 
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respect to the Lebesgue measure, mv{t, •) G PnL^(T‘^) for all t, and its density 
is solution of the Fokker-Planck equation 

dnii 


=0, t £ (0,T],x G 

(1-4) 

with the initial condition 

my{0,x) = mo{x), x gT^. (1-5) 

Therefore, the control problem consists of minimizing 

J{v,niy) = / f[my{t,-)]{x,v{t,x))my{t,x)dxdt+ h[my{T,-)]{x)my{T,x)dx, 

J[0,T]xT<i 

subject to (frui-ifTKi). In [g, A. Bensoussan, J. Frehse and P. Yam have proved that 
a necessary condition for the existence of a smooth feedback function v* achieving 
J{v*,my>) = min J(t;, to„) is that 

v*{t,x) = aTgT[im^(^f[m{t,-)]{x,v) + \'u{t,x) ■ g[m{t, •)](a;, r;)) , 

where (m, u) solve the following system of partial differential equations 
du, 


0 = 


dt 


(t, x) + vAu(t, x) + •)](a;, Vu{t, a;)) 


( 1 . 6 ) 


I Yd 


dH 

dm 


dm 


•)](?, Vu(t, Cj){x)m{t, ^)di, 
dH, 


0 = —(t,x) - i/Am(t,x)+div(m(t,-) — [m(t,•)](•, VM(t,-)))(x), (1.7) 


dt 


dp 


with the initial and terminal conditions 

m(0,x) = mo(a;) and u(T, x) = h[m{T, ■)]{x) + [ ^—[m{T, ■)]{^){x)m(T, ^)d^. 

J'j’d UTTl 

( 1 . 8 ) 

It will be useful to write 

/ O 

^'m{0-^H[m\{^,q{^)){x)d^ (1-9) 

for functions m G PnL^(T'^) and q G C(T'^;R'^), so that (11.61) can be written 
du 

0 = + I'AuU, x) + i7[m(t, ^((a;, Vuit, x)) + G[m(t, •), Vu(t, ^((a;). 

dt 


Remark 1. Note the difference with the system of partial differential equations 
arising in mean field games, namely 

du 

0 = —{t,x) + i'Au{t,x)+H[m{t,-)]{x,\7u{t,x)), (1-10) 

0 = ^(t,x) - i/Am(t,x)+div(^m(t,-)^[m(t,•)](•, VM(t,-)))(x),(1.11) 
with the initial and terminal conditions 


m(0, a;) = mo(a;) and u{T,x) = h[m{T,-)]{x). (1-12) 

Both the HJB equation (11.61) and the terminal condition on u in (11.81) involve ad¬ 
ditional nonlocal terms, which account for the variations of my caused by variations 
of the common feedback v. 
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Remark 2. At least formally, it is possible to consider situations when H and h 
depend locally on m, i.e. H[m\{x,p) = H{x,p,m(x)) and h[m\{x) = h{x,m{x))\ in 
this case, (ira-ira become 

du ~ 

0 = —{t,x) + h'Au{t,x)+H{x,'Vu{t,x),m(t,x)) (1-13) 

3H 

+m(t, —(x, x), m(t, x)), 

dm 

0 = - i^Am(t,x)+div(^m(t, •)^(-,Vu(t,-),TO(t,-)))(x), (1.14) 

with the initial and terminal conditions 

- dh 

m(0, x) = mo(x} and u(T,x) = h(x,m(T,x)) + m(T,x)— — (x,m(T,x)). (1-15) 

dm 


2. Existence results. We focus on the system (|1.6I1 - (I1.8I1 . We are going to state 
existence results in some typical situations. 


2.1. Notations. Let Q be the open set Q := (0,T) x We shall need to use 
spaces of Holder functions in Q: For a G (0,1), the space of Holder functions 
C“/^’“(Q) is classically defined by 


C“/2.“(Q) := 


wGC{Q) : 3C > 0 s.t. \/iti,Xi),{t2,X2) G Q, 

\w{ti,Xi) - w{t2,X2)\ < C {d{Xi,X2 f + \ti - 


and we define 

\w{ti,Xi) - w{t 2 ,X 2 )\ 

|ui|cc</ 2 ,o(Q) := sup _-^ 

iti,xj)^{t2,X2)£Q {d{xl,X2)‘^ + |tl - t2|) ' 

and ||rc||c“/ 2 ,c(Q) := ||w||c(Q) + I^Ic“/2.“(Q)- Then the space is made 

of all the functions w G C(Q) which have partial derivatives G C“/^’“(Q) for 
all i = 1,... jd and such that for all (ti,a;) ^ (i 2 ,x) G Q, |u'(ti,a;) — w{t 2 ,x)\ < 
C\ti — for a positive constant C. The space endowed 

with the semi-norm 


|U'|C(1 + C»)/2,1 + C(Q) 


dw , 


d 


|C“/2.“(Q) + 




sup 

,x}^(t2,x)GQ 


\w{ti,Xi) - w{t2,X2)\ 
|tl -i2|(l+“)/2 


and norm ||w||c(i+c<)/ 2 ,i+<»(q) := ||rc||c(Q) + |'fr’lcC+c<)/ 2 ,i+c(Q) is a Banach space. 
Finally, the space ci+“/ 2 : 2 -i-a jg of all the functions w G C^{Q) which are twice 
continuously differentiable w.r.t. x, with partial derivatives G 
for alH = 1,..., d, and ^ G C“/^’“((5). It is a Banach space with the norm 


l|t«llcl + “/2>2 + '»(Q) 



2.2. The case when dpff is bounded. We make the following assumptions on 
h, mo, H and G, in addition to the regularity assumptions on H already made in 

§[IJ 

(ido) Tor simplicity only, the map h is invariant w.r.t. m, i.e. h[m\(x) = ut{x), 
where ut is a smooth function defined on T'^. Moreover, mo is a smooth 
positive function. 
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{Hi) There exists a constant 70 > 0 such that 

\H[m]{x,Q)\ < 70 V(m,x) e (PnL^(T‘^)) x 


{H 2 ) There exists a constant 71 > 0 such that 

dH 

l|■^[’^^-]llLip(T‘^xR‘^) < 7l £ PnL^(T‘*) 

{H 3 ) For all {m,x,p) G (PnL^(T‘^)) x T'* x K.'^, ^[m]{x,p) is a function on 

and there exists a constant 72 > 0 such that for all {m,x,p) G (PnL^(T'^)) x 

X W^, 

II^H(^,P)llcMT<^)<72(l + bl) 

{Hi) There exists a constant 73 > 0 such that: 


dH dH 

II —[mi](-,0) - -^i^[TO2](•,0)||c(T<^) < 73l|wi -TO2||Li(T‘i) Vmi,m2 G L^{T‘^). 

(iJs) There exists 74 > 0 such that for mi,m 2 G PnL^(T'^), pi,p 2 G L°°{T'^), 
\\G[mi,pi] - G[m 2 ,_P 2 ]||L=(T‘i) < 74 (Ibl - P 2 ||L=°(T-i) + ll"4l - m 2 ||Li(T-i)) ■ 
Example. All the assumptions above are satisfied by the map H : 

$(p) 


H[m\{x,p) = - 


(c+ {pi * m){x))<^ 


+ F{x,{p 2 *m){x)), 


where d) is a function from to K+ such that and £)$ are bounded, a and c 
are positive numbers, pi and p 2 are smoothing kernels in C°°(T‘^), pi is nonnegative, 
and F is a function defined on T'^ x Here, p * m{x) = p{x — z)m{z)dz. 
It is easy to check that 


G[m,q]{x) 


api * I m 


$(g) 


(c + Pi * m)“+^ 


{x) + p 2 * {mF'{-,p 2 * m)){x) 


where pi(x) = pi(—x) and P 2 {x) = p 2 {—x). 

Such a Hamiltonian models situations in which there are congestion effects, i.e. 
the cost of displacement increases in the regions where the density is large. The 
term F{x, (p 2 * m){x)) may model aversion to crowded regions. The prototypical 
situation is g[m]{x, a) = a and <I>(g) = minbg;c(9 ’ ^ where /C is a compact 

subset of Setting $*(&) = +00 if b ^ /C, H corresponds to the cost f[m]{x,a) = 
+ (^1 * TO)(a;))“) + F{x, (P2 * m){x)). 


2 . 2 . 1 . A priori estimates. We first assume that (fra-(fra has a sufficiently smooth 
solution and we look for a priori estimates. 

Step 1: uniform bounds on ||m||LP(o,T;Wi>p(T‘^)) + II™IIc“/ 2 >“(Q )5 P S [ 1 , 00), a G 
[ 0 , 1 ). First, standard arguments yield that m{t, •) G P for all t G [ 0 ,r]. 

From Assumption {H 2 ), the function b : {t,x) i-A dpH[m{t,-)]{x,\7u{t,x)) is such 
that |b||Lcx,(Q) < 7 i. The Cauchy problem satisfied by m can be written 


dm 


{t, x) — i/Am{t, x) + div{b{t, ■)m{t, ■)){x) = 0 , 


m(0, x) = mo{x), 


( 2 . 1 ) 
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and from the classical theory on weak solutions to parabolic equations, see e.g. 
Theorem 6.1 in there exists a constant Co depending only on ||TOo||i 2 (T>i) such 
that 

Moreover, since the operator in m is in divergence form, we have maximum 
estimates on m, see Corollary 9.10 in [14]: there exists a constant Ci depending 
only on ||mo||oo and 71 such that 

m{t, x) < Cl V(t, x) G [0, T] X (2.2) 

Therefore, the Fokker-Planck equation in (12.11) can be rewritten 


diTi 

-^(t, x) — lyAmit, x) + div(5(i, •))(x) = 0 , 
ot 


(2.3) 


where ||S||oo < liCi. From from standard results on the heat equation, see uni, 
this implies that for all p G [1, oo) there exists a constant C 2 (p) which depends on 
II Wo I loo and 71 , such that 

dfri 

Finally, Holder estimates for the heat equation with a right hand side in divergence 
form, see for example Theorem 6.29 in yield that for any a G (0,1), there exists 
a positive constant C 3 {a) > Ci which only depends on 71 and on ||mo||cc(ir'i) such 
that 

||w||c<./ 2 ..(Q) < Coia). (2.5) 

Step 2: uniform bounds on ||m||c(i+s)/ 2 ,i+ 0 (q), 0 G (0,1). Defining 

pi 

a{t,x) := —H[m{t,-)]{x, 0 ) and A{t,x) := / ——[m(t, •)](x, CVu(t, a:))dC, 

Jo up 

the HJB equation (11.61) can be rewritten 
Ou 

— {t,x) + i'Au{t, x) + A{t, x) ■ x) = a{t, x) — G[m{t, •), Vu(t, •)](x). (2.6) 

For some smooth function u, let us consider 
du 


dt 


it, x) + vAuit, x) + A{t, x) ■ Vu{t, x) = a{t, x) — G[m(t, •), V?i(t, •)](3^) (2.7) 


instead of (12.61) . with the same terminal condition as in dEHj). From Assumption 
{Hi) and {H 2 ), ||a||oc. < 7 o and ||A||oo < 7 i. From Assumption {H 3 ), 

||G[m, VM]||i 2 (T<i) < c(l + IIVM||i 2 (T<i)), (2.8) 

where c > 0 depends on Gi in (12.21) and 72 . Multiplying (12.71) by u{t,x)e~^^* and 
integrating on T'^, then using the bounds on ||a||oo, || A||oo < 71 and ( 12 .8L a standard 
argument yields that there exist constants A and G4 which depend only on 70, 71 , 
72 , ||wo||oo such that 

- ^ (lk(T - t, •)lli 2 (T^)e-"^(^-‘^) + ^^11 Vu(T - t, •)||i2(T.)e-2^(^-‘) 


<G4 + -||Vu(r -1, •)lli 2 (T.)e-^^(^-*). 


(2.9) 


Hence, if 


i/ / ||Vu(T-t,.)||i2(Td)e-'^(^-‘)dt<G4, (2.10) 
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with 

C 4 = 2 C 4 T + 2 f u^x)dx, (2.11) 

Jfd 

then 

[ u^{T — t,x)dx + V [ \\\7u(T — t,-)\\'^^ 2 rjd)e~'^^^'^~'‘''^dt < C 4 . 

t JTd Jt=0 

( 2 . 12 ) 

Similarly, a solution of (II.61) - (II.81) satisfies (12.121) with the same constants A and 
C 4 . Note that A can be chosen large enough such that the function {t,x) i-A- ut{x) 
satisfies (j 2 . 12 |) . 

For a solution of (jl. 6 l) - (jl. 8 p . this implies that dtu + vAu is bounded in L^{Q), 
hence that u is bounded in C°( 0 , T; i?^(T‘^)) by a constant C 4 > ||wT||ffi(Trf) which 
depends on A, C 4 , 71 and i-®- 

IIVM||Loo(o_T;ffi(T<i)) < C 4 . (2-13) 

As a consequence, the left-hand side of (12.61) is bounded in L°°{Q), and this yields 
Holder estimates on u: by using Theorem 6.48 in [14], we see that for all 9 G (0,1), 
there exists a constant C 5 ( 9 ) which depends on 9, ||mo||oo, ||'«T||ci+«(T<i )5 7 o, 7 i, 72 
such that 

ll''^llc(i+'’)/ 2 .i+e(Q) < (^ 5 ( 9 ), (2-14) 

which holds for a solution of ()2.7I) with the terminal condition (|1.8I) . as soon as u 
satisfies (12.121) and (12.131) . 

Step 3: uniform bound on ||TO||c(i+e)/ 2 ,i+e(Q), 9 G (0, 1). Let us go back to (11.71) . 
From Assumptions (iLi) — (^ 4 ), and from the previous two steps, we see that for 
any 9 G (0,1), m and ^[m]{-,Vu) are both bounded in by constants 

which depend on ttiq and ut, and 70,..., 73 . Thus, the function B in (12.31) is 
bounded in Using Theorem 6.48 in [M] for the heat equation with a data 

in divergence form, we see that for all 9 G (0,1), there exists a constant C6(9) which 
depends on 9, ||mo||ci+«(T'i), I|ut||ci+»(T‘'), 7 o ,---,73 such that 

||m||c(i+e)/2,i+i3(Q) < C6(9). 

Step 4: uniform bounds on ||u||ci+8/2,2+i3(q), 9 G (0,1). From the previous steps 
and Assumptions (iLi) — (^^ 4 ), we see that there exists a constant c such that the 
functions in (12.61) satisfy ||a||cfl/ 2 ,e(Q) < c and ||24||ce/2,6i(Q) < c. Similarly, from 
Assumptions (Jda) and (Ids), ||G[m, Vu]||ce/ 2 , 6 i(Q) < c. Standard regularity results 
on parabolic equations, for instance Theorem 4.9 in |14j lead to the existence of 
C 7 ( 9 ) such that 

||u||ci+e/ 2 , 2 +e(Q) < 07(9). 


2.2.2. The existence theorem. 

Theorem 1. Under the Assumptions fora G (0,1) there exist functions 

u G and m G which satisfy U.6\) - U.8\) . ( note that 

O is satisfied in a weak sense). 

Proof. The argument is reminiscent of that used by J-M. Lasry and P-L. Lions for 
mean field games: it is done in two steps 
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Step A. For i? > 0, let 77 ^ : K —R be a smooth, nondecreasing and odd function 
such that 

1- ’HR^y) = 2 / if \y\ < R, VR{y) = 2Riiy>3R 

2 - II^rIIoo < 1 

We consider the modified set of equations 
dll 

0 = —{t,x) + iyAu{t,x) + H[m{t, •)](x, VM(t,x)) + r]R{G[m{t, •), Vu(t, •)](x))(2.15) 

0 = ^{t,x) - iyAm{t,x) + ■)]{■, Vu{t,-))^{xl2.16) 

We are going to apply Leray-Shauder fixed point theorem to a map x defined for 
example in X = {m G C°([0, T]; L^(T'^) flP)}: consider first the map tp : X ^ X x 
i^(0,T;i7^(T'^)), m i-A {m,u) where it is a weak solution of (12.151) and it|t=T = ut- 
Existence and uniqueness for this problem are well known. Moreover, from the 
estimates above, for every 0 < a < 1 , ||it||ci/ 2 +Q/ 2 ,i+c(Q) is bounded by a constant 
independent of m and m it is continuous from X to 

Fix 9 G (0,1), and consider the map ^ : X x —>■ L^(0,T;i7^(T‘^)), 

(to, u) ^ fh where tti is a weak solution of the Fokker-Planck equation 

0 = ^{t,x) - vArh{t,x) + dx{m{t,-)^[rn{t, ■)]{■, Vu{t,-))^{x). 

and rh\t=o = ^o- Existence and uniqueness are well known, and moreover, the 
estimates above tell us that for all 0 < a < 1, there exists Ra > 0 such that 
||TO||(;;a/ 2 ,a(Q) < Ra Uniformly with respect to to and it. Moreover from the assump¬ 
tions, it can be seen that C maps continuously X x (Q) to X. 

Let K be the set {||to| 1 cc</ 2 .c<(q) < Ra','m\t=T = totIHX: this set is a compact and 
convex subset of X and the map X = C°^' rn ^ fh is continuous in X and leaves 
K invariant. We can apply Leray-Shauder fixed point theorem the map Xi which 
yields the existence of a solution {uR,mn) to (I2.15I) - (I2.16I) . Moreover the a priori 
estimates above tell us that ur G C^+“/^’^+“((3) and to_r G 

Step B. Looking at all the a priori estimates above, it can be seen that mu, (resp ur) 
belongs to abounded subset ofC“'^^’“(Q) (resp. independent of i?. 

Hence, for R large enough, riR{G[mR, Vit^]) = G[mR, Vit/j], and (to/j, ur) is a weak 
solution of (ll. 6 l) - (ll. 8 l) . with ur G C^+“/^’^+“((3) and tur G □ 

Remark 3. It is possible to weaken some of the assumptions in Theorem [T] for 
example, we can assume the following weaker version of {H 2 ), namely: 

{H 2 ) There exists a constant 71 > 0 and 7 G (0,1) such that 

• Vto G PnLi(T'^), ||||Hllc(T<ixR‘i) < 7i 

• Vto G P(~|L^(T'^), x,i/ G T'^, p, q G 

\ — [m]{x,p) - —[m]{y,q)\ < xi{d{x,y) + Ip - gD 

Indeed, the regularity of ^ with respect to p is only used in Steps 3 and 4 above: 
with this weaker assumptions, the conclusions of steps 3 and 4 hold with 0 < 
9 < r], and this is enough for proving the existence of u G and 

TO G for some a, 0 < a < rj which satisfy ()1.6I1 - (I1.8|) . 
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2.3. Hamiltonian with a subquadratic growth in p: a specific case. For a 

smooth nonnegative periodic function p, two constants a > 0 and /3, 1 < /3 < 2, let 
us focus on the following Hamiltonian: 


Him] {x,p) 

The map G defined in (HH) is 


\p\^ 

(1 + (p * m)(x))“ ' 


(2.17) 


G[m, g](a;) = a 




(i + (p*m))“+^yy 


(a;), 


where p(x) := p(—x). 

Assuming that mo is smooth, let us call fho = ||too||oo: for all a; G T'^, 0 < mo{x) < 
fho- We assume that 

l|p||Li(T‘i) < ^ - ■ (2-18) 

amo 

Remark 4. It would be interesting to make further investigations to see if the as¬ 
sumption on the regularizing kernel p in (12.181) is really necessary, since it is not nec¬ 
essary in the context of mean field games with congestion. Yet, in the a priori esti¬ 
mates proposed below, (12.181) is useful for getting a bound on Vu)||ii(Q), 

see (12.201) . 


2.3.1. A priori estimates. We first assume that dUD-dni) has a sufficiently smooth 
weak solution and we look for a priori estimates. 

Step 1: a lower bound on u. Since G is non negative, by comparison, we see 
that 

M(t, x) > Urp := min u(T, V(t, x) G [0, T] X T'^. 

Step 2: an energy estimate and its consequences. Let us multiply ()1.6|) by 
m — fho and (HH) by u and integrate the two resulting equations on Summing 
the resulting identities, we obtain: 

[ - 7 r{u{t,x){m{t^x) — mo))dxdt + f H[m(t,-)]{x^'Vu(t,x)){m{t,x) — mo)dxdt 
JQ Jq 

/ G[m(t, •), Vu(t, •)](a:)(m(<, x) — mo)da:dt 

JQ 

+ J div ^m(t, x)—•)](x, Vit(f, x))^ u{t,x)dxdt = 0 


Hence 


/ u{T,x){m{T,x) — mo)dx + / u(0, x)(mo — m(0, x))da 

JTd- JTd- 

= / H[m{t,-)]{x,\7u{t,x)){fho — m{t,x))dxdt 
JQ 

-I- / G[m{t, ■),\7u{t, ■)]{x){mo — m{t, x))dxdt 

Jq 

f 9 

+ / m(t,x)—H[m{t,-)]{x,Vu{t,x))-Vu(t,x)dxdt 

Jq 9p 


(2.19) 
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In (I2.19|l . the first term in the left hand side is bounded from below by — ||ur||oo(l + 
mo), The second term is larger than u^p — m(0, x))dx = (mo — l)^^- There¬ 

fore, the left hand side of (12.191) . is bounded from below by a constant c which only 
depends on mo and ||ut||oo; we obtain that 

c <(/3 — 1) / m{t,x)H[m{t,-)]{x,Vu{t,x))dxdt + / fhQH[m{t,-)]{x,Vu{t,x))dxdt 

Jq Jq 

+ ot J^{rho-m{t,x))p* (^m(t, ^ ^ j {x)dxdt. 

We see that last term can be bounded as follows: 

f ifho-m{t,x))p* {x)dxdt 

Jq \ (1-f p*m(t,-))“+V 

<mo f p* (Mtr) 'll {x)dxdt 

Jq \ {^ + J 

f |Vu(t x)\^ 

= — mo||p||j;,i(T<i) / rn{t^x)H[m(t,-)\{x,yu{t^x))dxdt. 

Jq 

Therefore, 

c < (/3 — 1 — Q;mo||p||Li(T<i)) / m{t,x)H[m{t,-)]{x,\7u{t,x))dxdt 

Jq 

-f / fhoH[m{t,-)]{x,\7u{t,x))dxdt. 

Jq 

From (12.171) and (I2.18|) . we see that there exists a constant Ci which depends on 
mo and ||ut||oo such that 


||mi7[m](-, Vu)IUi(Q) + ||i7[m](T Vu)|Ui(q) < Ci. ( 2 . 20 ) 

Using (12.201) . we deduce from a comparison argument applied to the HJB equation 
that there exists a constant C 2 which depends on ffiQ and ||ut||oo such that 


||m||l°°(Q) < C'2- 


( 2 . 21 ) 


Since 1 < /I < 2, there exists a constant c such that |^^^(ai,p)P < c(l — 
H[m]{x,p)). We deduce from ( 12 . 201 ) and the latter observation that there exists 
a constant C 3 > 0 such that 


(m(f, x) + 1 ) 


dH[m{t, •)] 


dp 


{x, 'S/u{t, x)) 


dxdt < C 3 . 


( 2 . 22 ) 


Step 3: uniform estimates from the Fokker-Planck equation. The following 
estimates can be proved exactly as in m, Lemma 2.3 and Corollary 2.4, (see also 
[^, Lemma 2.5 and Corollary 2): 
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Lemma 2. For 7 = if d > 2 and all j < 2 if d = 2, there exists an constant 
c > 0 , (independent from mo and ut) such that 

sup \\m{t, ■) \og{m{t, •))llLi(Trf) + II Vm|li 2 (o + II”^IIIt(q) 

te[o,T] 


<c 


l(t, x) 


dH[m{t, •)] 


dp 


{x, Vult, x)) 


dxdt 


Ijd 


mo{x)\og(mo{x))dx . 


(2.23) 


Corollary 1. For q = if d > 2 and q < 4/3 if d = 2, there exists a constant 
c > 0 such that 


Y"'-IIl 9(Q) + II llL9(0,T;VU-U9(Trf)) 


<C 


m(t, x) 


dF[[m{t, •)] 


dp 


X, Vult, x)) 


dxdt 


/fd 


mo{x)\og{mo{x))dx . 


(2.24) 


From (j2.24ll and (12.2211 . we have a uniform bound on ||^||^<,(q by a 

constant depending only on ut and mp. We infer that (II.6|) can be written 

Ou 

— (t, x) + vAuft, x) + a(t, x)\S/u\^{t, x) = b{t, x), (2.25) 

where a is a function which belongs to C([0, T];C^(T'^)) for all p G N, with corre¬ 
sponding norms bounded by constants depending only on ut and mp. From (12.201) . 
we deduce that for allp S N, ||&||li(o,T;Wj>.“(T‘*)) is bounded by a constant depending 
only on ut and mp, because 


Il1(0,T;Wp.“(T‘^)) — I|G[™Y^^]IIl1(0.T;WP'“(T‘^)) 

m|Vu|^ 


< c 


(1 -I- (p * m)) 


a+1 


L1(Q) 

< c||miJ[m](-, Vu)llii(Q). 


Step 4: uniform estimates on |Vit|. Since a G C([0,T];Cp(T'^)) and 
b G L^(0,T;WP'°°(T‘^)), we can apply Bernstein method to (|2.25|1 and estimate 
|Vm|. By a slight modification of the proof of Theorem 11.1 in [14], (the only 
difference is that in [T3], b is supposed to belong to 1 FP’°°(T^)), but it can 

be checked that this assumption can be weakened), we prove that there exists a 
constant C 4 which depends on ut and mp such that 


llVulUoo(Q) < C 4 . (2.26) 

The proof adapted from [Mj is rather long, so we do not reproduce it here. 

Step 5: stronger a priori estimates. Since |Vu| is bounded, we can recover all 
the a priori estimates in § 12.2.11 except that the estimates in Step 3 and 4 of § 12.2.11 
only hold with O<0<,8—l,in view of Remark[3| We obtain that for all 7 G (0,1), 
there exist two constants C 5 ( 7 ) and Ce{'y) such that ||m||c-y/ 2 , 7 (Q) < C 5 ( 7 ) and 
ll“llc(i+T)/ 2 >i+'y(Q) < ^* 5 ( 7 ), and that for all 9 G (0,/3 — 1), there exist two constants 
Cy{9) and such that |jm|j(;;(i+£t)/ 2 ,i+£»^Qj ^ and |['u||(^i+e/ 2 , 2 +e^Qj ^ 
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2.3.2. The existence theorem. 


Theorem 3. We assume (Hq) and For 7 , 0 < 7 < /3 — 1, there exists a 

function u G and m G which satisfy U.6\} - U.8\} with 

H given by 

Proof. We start by suitably truncating the Hamiltonian H and the map G: for 
R> 1, define 

\pf 


Hii[m]{x,p) = < 


and 


Note that 


g](a;) = a \ p* [m 


(1 + (p * m){x))°‘ 

(1 + (p * m)(x))“ 

min(|( 7 |^, 


(1 + (p * j 

\p\P 


if \p\ < R, 
if \p\ > R, 

(x). 


(2.27) 


(2.28) 


-Hii[m]{x,p) + —Hii[m\{x,p)-p = 


-(/3-1) 

-(/3-1) 


(1 + (p * m){x)Y 
Rf^ 

(1 + (p * m){x)Y 


if \p\ < i?, 
if \p\ > R. 


(2.29) 

Thanks to Remark [31 we can use a slightly modified version of Theorem [TJ for some 
7 , 0 < 7 < /? — 1 , there exists a solution [ur, niR) of 

du 

0 = -^{t,x) + nAuR{t,x) + HR[mR{t,-)]{x,yuR{t,x)) + GR[mR{t,-),VuR{t,-)]ix), 


0 = 


dmR 

dt 


{t,x) - nAmR(t,x)+diY(mR(t, ■)^^[mR{t, ■)]{■,'^UR{t,-)Yx) 


with the initial and terminal conditions (11.81) . such that ur G C^+'''/^’^“*'^((5) and 
mR G C(^+'^)/^’^+'^(Q). 

Then it is possible to carry out the same program as in Step 1 and 2 in § 12.3.11 
using (I2.27I) - (I2.29I) . we obtain that there exists a constant c independent of R such 
that 

|V'Ui^(t,a;)|^ 


c < - (/3 - 1 - amollpllLi(Td)) / mR{t,x) 

JQ 

- (/3 - 1 - Q;7Tio||p||Li(T<i)) / mR{t,x) 

Jo 


{1 + p* mR{t, x)r 

' (1 + p * mR{t, a:))“ -)\>R}dxdt 


+ / moHR[mR{t,-)]{x,VuR{t,x))dxdt, 

Jq 

and this implies the counterpart of (|2.20|) : there exists a constant G independent 
of R such that 


(1 + {p*mR)) 

From this, we obtain the counterpart of (12.221) : 

dHR[mR{t,-)] 


LHQ) 


{mR{t,x) + 1 ) 


dp 


{x,VuR(t,x)) 


dxdt < G, 


(2.30) 


(2.31) 
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where C is a constant independent of R. This estimate allows one for carrying out 
Steps 3 and 4 in ? l2.3.1l and obtaining estimates independent of i?: in particular, the 
same Bernstein argument can be used, and we obtain that there exists a constant 
independent of R such that \\\7u}i\\L°°{Q) < C. In turn, step 5 in ? 12.3.11 can be 
used and leads to estimates independent of R. 

From this, taking R large enough yields the desired existence result. □ 


3. Uniqueness. 


3.1. Uniqueness for (ll.6p - (ll.8|) : a sufficient condition. In what follows, we 
prove sufficient conditions leading to the uniqueness of a classical solution of (fra - 
o. For simplicity, we still assume that the final cost does not depend on the 
density, i.e. that there exists a smooth function ut such that h[m\{x) = ut{x). In 
order to simplify the discussion, we assume that the operator H depends smoothly 
enough on its argument to give sense to the calculations that follow. 

We consider two classical solutions (u, m) and (ft, m) of 

Ou 

0 = -—{t,x) + L'Au{t,x)+H[m{t,-)]{x,Vu{t,x)) (3-1) 

f BH 

rim / f) M \ 

0 = — {t,x)-vAm{t,x)+div\^m{t,-) —[rn(t, ■)]{■, Vu{t,-))yx), (3.2) 

and 

du 

0 = (3.3) 

/* dH 
Jjd dm 

0 = ^(t,x)-iyAm{t,x) + div(m{t,-)^[rh{t,-)]{-,Wu{t,-))J{x). (3.4) 

We subtract (|3.3I) from (13.IL multiply the resulting equation by {m{t, x) — rh{t, x)), 
and integrate over Q. Similarly, we subtract (13.41) from (13.21) . multiply the resulting 
equation by {u(t,x) — u{t,x)), and integrate over Q. We sum the two resulting 
identities: we obtain 


0 = / {u{T, x) — u(T, x))[m{T, x) — m(T, x))dx 

JT'^ 

— J {u{0,x) — u{0,x)){m{0,x) — m{0,x))'^dx (3.5) 

+ f E[m{t,-),'Vu{t,-),rh{t,-),'Vu{t,-)]dt. 

Jt=o 


where 


E[mi,pi,m 2 ,P 2 ] = / {H[mi]{x,pi{x)) - H[m 2 ]{x,p 2 {x))){mi{x) - m 2 {x))dx 

Jfd 

+ ^_^("ii(a:) - m2{x)) - ^[TO2](^,P2(0)(a:)™2(C)^ d^dx 

- J (^mi{x)-^H[mi]{x,pi{x)) - m 2 {x)-^H[m 2 ]{x,p 2 ix))^ {pi{x) - p 2 {x))dx. 
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Call 6m = m 2 — mi and 6p = P 2 —Pi and consider the function e : [0,1] —>■ K. defined 

by 


e{9) = -E[mi,pi,mi + 9Sm,pi + 96p], 9 > 0, 

e(0) = 0. 

It can be checked that e is on [0,1] and that its derivative is 

e'{9) = 2 f / + dSm]{^,pi + 96p{i)){x)6m[C)5m{x) 

Jjd Jfd am 


(3.6) 




[mi + 9Sm]{^,pi + 9Sp{^)){x){y)Sm{x)Sm{y) 


j {mi{x)+9dm{x))dp{x)-DppH[mi+9dm]{x,pi{x) + 96p{x))Sp{x). 

JTd 


(3.7) 


Let us introduce the functional defined on C{T‘^) x C(T‘^;]R‘^) by 


'H[m,p] := / m{x)H[m]{x,p{x))dx. (3.8) 

JTd 

The second order Frechet derivative of 'H with respect to m (respectively p) at 
{m,p) is a bilinear form on C(T'^), (resp. C(T'^;R'*)), noted D‘^ .^'H[m,p\, (resp. 
Dpp'H[m,p]) . For all m G C(T'^) fl P and all p G C(T'^;R'^), let us define the 
quadratic form Q[m,p] onC(T‘') x C(T'^;R‘^) by 

Q[m,p](^,7r) = D^ „,'H[m,p](^,/r) - i7p p'H[m,p](7r,7r). (3.9) 

We see that (1X71) can be written as follows: 

^{9) = Q[mi + 95m,Pi + 95p]{5m,5p). (3.10) 

Theorem 4. We assume {Hq) and that (m,x,p) 1— >■ H\m\{x,p) is on C(T'^) x 
X A sufficient condition for the uniqueness of a classical solution of ra- 
il.8\) is that 

1. for all m G C(T'^) D P and all p G C(T'^;R'^), the quadratic form 

p I—>■ ^'H[m,p]{p, p) is positive definite 

2. for allm G C(T'^)nP andx G the real valued function p G R'^ H> H[m]{x,p) 
is strictly concave. 


Proof. From the concavity of p i-A H[m]{x,p), —Dp fH[m,p] is positive semi-definite. 
Therefore, Q[m,p] is positive semi-definite, and Q[m,p]{p,Tr) = 0 implies that 
= 0 s-nd —D^p'H{m,p\{'K,TT) = 0, and therefore p = 0. 

From (13.5F two solutions (u, m) and (u, m) of dreli-dLS]) satisfy 


[ E[m{t, •), Vu(f, ■),m{t, ■),Vu{t, ■)]dt = 0, 

Jt=o 


(3.11) 


because m(0, •) = m(0, •) and u{T, •) = u(T, •). 

But, from (13.61) and (l3.inL the properties of the quadratic form Q[{1 — 9)m{t, ■) + 

9rh{t, •), (1 — 9)Vu{t, •) -I- 9Vu(t, •)] imply that 

/t=o ■): Vu(t, •), m{t, •), Vu(f, ■)]dt > 0 if m ^ m. 
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Therefore, (I3.11|) implies that m = m. Then, 

0 = 

f (OH OH \ 

J m{t,x) f — [m(t, •)](a;, Vu(t,a;)) - — [m(t, •)](a;, Vu(t, a:)) j • (Vu - Vu){t,x). 

(3.12) 

If > 0, then the maximum principle implies that m{t, x) > 0 for alH > 0, a; G T'^. 
This observation, (13.1211 and the strict concavity of H with respect to p imply that 
'S/u{t,x) = 'Vu{t,x) > 0 for all t,x, which yields immediately that m = u by using 

(fra . □ 

Remark 5. Let us give an alternative argument which does not require the knowl¬ 
edge that m{t,x) > 0 for all t > 0,a; € T'^. Such an argument may be useful 
in situations when = 0 or is replaced in (nm by a function of x which van¬ 
ishes in some regions of T'^. The strict concavity of H with respect to p and 
(I3.12|) yield the fact that u = u in the region where m > 0. This implies that 
G[m{t, Vu(t, x)) = G[m{t, •)](a;, Vu{t,x)): hence, for all t and x, 

Oil 

— (i, x) + x) 4- Hlmit^ ‘)](^? Vu(t, x)) 

Ot 

Ou 

=-—(t, x) + vAuit, x) + O]):!;, Vuit, x)). 

at 

We can then apply standard results on the uniqueness of the Cauchy problem with 
the HJB equation ^{t,x) + vAu{t, x) + OKa;, Vit(t, x)) = g and obtain that 

u = u. 

Corollary 2. In the case when H depends locally on m, i.e. 

H[m\{x,p) = H{x,p,m{x)), 

the sufficient condition in Theorem^is implied by the strict concavity of p G i—>■ 
H{x,p,m) for all m > 0 and x G and the strict convexity of the real valued 
function m G R+ i—^ mH{x,p,m), for all p G M'^. 

Example. Consider for example the Hamiltonian 

\v\^ 

H[m]{x,p) = H{x,p,m{x)) = ——— + F{m{x)), (3.13) 

(c -I- m(x))“ 

with c>0, a>0, /3>l,E'a smooth function defined on R+. One can check that 
if a < 1 and F is strictly convex, then uniqueness holds. 

Such a Hamiltonian arise in a local model for congestion, see [15]. 

Remark 6. The same analysis can be carried out for mean field games, see [15]: 
for example, under Assumption {Hq) and in the case when H depends locally on 
TO, i.e. H[m\{x,p) = H(x,p^m(x)), a sufficient condition for the uniqueness of a 
classical solution of (I1.10D - (I1.12D is that 

( 2ff(:c,p,TO) -^VJR(x,p,to)\ 

-2Tlp,pR(a:,p,TO) j 

be positive definite for all x G to > 0 and p G Here, we see that the 
sufficient condition involves the mixed partial derivatives of H with respect to m 
and p, which is not the case for mean field type control. If H depends separately 
on p and to as in [13], then pH{x,p,m) = 0 and the condition becomes: H is 
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strictly concave with respect to p for m > 0 and non decreasing with respect to m, 
(or concave with respect to p and strictly increasing with respect to m). 


Remark 7. The extension of the result on uniqueness to weak solutions is not 
trivial. In the context of mean filed games, one can find such results in [18] and 
m- roughly speaking they rely on some new uniqueness results for weak solutions 
of the Fokker-Planck equation and on crossed regularity lemmas, see Lemma 5 in 
m- In the context of mean held type control, the same kind of analysis has not 
been done yet. 

In the case when n = d, g[m] (x, v) = v and v >—>■ f[m] (x, v) is strictly convex for all 
TO G P and X G T'^, it is well known that f[m]{x,v) = sup^gjjd {H[m]{x,q) — q ■ v). 
Furthermore if p i-A H[m]{x,p) is strictly concave for all to G P and x G T^, then 

/[to](x, v) = max {H[m\{x, q) — q ■ v) (3.14) 


and the maximum is achieved by a unique q. This observation leads to the following 
necessary condition for the assumption of Theorem |4| to be satished. 


Proposition 1. Assume that n = d, g[m]{x,v) = v, that v i— f[m]{x,v) is strictly 
convex for all m G V and x G T”*, and that p H> H[m]{x,p) is strictly concave for 
all m G ¥ and x G T'^. If for all p G TO I— 'H[m,p] is strictly convex 

in PnC(T‘^), then for all v G to i—>■ m(x)flm](x, v(x))dx is strictly 

convex in PnC(T‘^). 

Proof. Take Ai > 0 and A 2 > 0 such that Ai + A 2 = 1 and toi ^ m 2 in PnC(T‘^). 
From (13.1411 . 


Ijd 


(AiTOi(x) + A 2 TO 2 (x))/[AiTOi + A 2 TO 2 ](x, v{x))dx 


= / max(AiTOi(x) + A 2 TO 2 (x)) (iL[AiTOi + A 2 TO 2 ](x, ( 7 ) — gi;(x)) dx. 

Jjd gGR-i 

If for all X G T'^, the maximum in the latter integrand is achieved by q*{x), then 
X i-A q*{x) is a continuous function (from the continuity of v) and we have 


/ (AiTOi(x) + A 2 TO 2 (x))/[AiTOi + A 2 TO 2 ](x, p(x))dx 

= max / (AiTOi(x) + A 2 TO 2 (x)) (iLlAiTOi + A 2 TO 2 ](x, ( 7 (x)) — g(x)u(x)) dx. 
geC(T‘*;R<i) 

From this and the convexity of to 1 —>■ 'H[to,p], we deduce that 

/ (AiTOi(x) + A2TO2(x))/[AiTOi + A2TO2](x,u(x))dx 


Ai /jd (TOi(x)id[ toi](x, q(x)) - q(x)v(x)) dx+ 
geC^T^hR"^) V ^2 fjd (TO2(x)id[TO2](x,g(x)) - q(x)v(x)) dx 


< max 


<Ai max / 

geC(T‘^;R‘^) J^d 
+ A 2 max 


(TOi(x)id[TOi](x, q(x)) — q(x)v(x)) dx 


J'jd 


(TO2(x)id[ to2](x, q{x)) — q{x)v{x)) dx 


=Ai / toi(x)/[toi](x, i;(x))dx + A 2 / TO2(x)/[to2](x, x(x))dx. 


□ 
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3.2. Back to the control of McKean-Vlasov dynamics. As in the end of the 

previous paragraph, we assume that n = d and g[m]{x,v) = v. The control of 
McKean-Vlasov dynamics can be written as a control problem with linear con¬ 
straints by making the change of variables z = mv: it consists of minimizing 


J{z,m^) = / f[m,it,-)] 

Jq 


zit,x) 

{t,x) 


subject to the linear constraints 
dm 


mz{t,x)dxdt+ / UT{x)mz{T,x)dx, 

J-fd 

(3.15) 


dt 


{t,x) — vAmz{t,x) + divz{t,x) = 0 t £ (0,T],x € T“, (3.16) 


with the initial condition 


mz{0,x) = mo{x), a; £ T^. (3-17) 

For simplicity, we assume that / depends locally on m, i.e. 

/[to] {x, v(x)) = f {x, v{x), m{x)) , Vcc £ 

We are going to look for sufficient conditions for (z,m) i—>■ mf{x, be a convex 

function. This condition will thus yield the uniqueness for the above control prob¬ 
lem. 

Assuming that all the following differentiations are allowed, we see that the Hessian 
of the latter function is 

^ ^ ■ I {^,m)z ^DlJ (^,to) ) 


+ ^ ^ (^,to) 


dVyf 

dm 


where we have omitted the dependency on x for brevity. This is better understood 
when expressed in terms of (u,to): 


0(a 


We have proved the following 



dm 


(x, V, to) 


sv;/ / o 
mB^^f(x,v,m)y 


(3.18) 


Proposition 2. We assume thatn = d and g[m\{x,v) = v, and that f[m\ (x,v(x)) = 
f {x,v{x),m{x)), for all x £ where f is a smooth function. A sufficient condi¬ 
tion for the uniqueness of a minimum {z*,m*) such that to* > 0 is that Q(x,v,m) 
be positive definite for all x £ to > 0 and v £ R'^. 


Proposition 3. We make the same assumptions as in Proposition\^ The positive 
definiteness of Q{x,v,m) for all x £ to > 0 and v £ implies the sufficient 
conditions on H in Corollary\^ 

Proof We observe first that the positive definiteness of 0 implies that Dl^^f^x, v, to) 
is positive definite for all a; £ T"^, to > 0 and u £ 

Let us call v* £ the vector achieving H{x,p,m) = p ■ v* f{x,v*,m). We 
know that VpiL(x,p, to) = v*. Differentiating the optimality condition for v* with 
respect to p, we find that 

Dl pH{x,p,m) = - (^Dl j{x,v*,m)^ 


( 3 . 19 ) 









MEAN FIELD TYPE CONTROL 


19 


Note that (I3.19|l implies the strict concavity of p i-A H{x,p,m) which is the first 
desired condition on H. The second condition on H will be a consequence of the 
implicit function theorem: differentiating H with respect to m, we find that 


— {x,p,m} = —{x,v ,m) + Vyf{x,v (3.20) 

where the last identity comes from the definition of v*. Differentiating once more 
with respect to m, we find that 

, d^f, . , , dvj, , , dv- 

.™) + ^(P.P (3-21) 

Then the implicit function theorem applied to the optimality condition for v* yields 
that 

dv* . N-iav,/, 


From (13.191) - (I3.22L we see that 


dm 


-{x, V*,m). 


dm^ 


(rnH{x,p,m)^ = (mf{x,-,m)^ {v*) 


dVyf 

dm 


{x,v*,m)'\ ■ (mDl.^f{x,v*,m)j (m^^^{x,v*,m)'\ . 


(3.22) 


(3.23) 


Hence, (jnH{x,p,m)j is a Schur complement of 0(a;,n*,m). Therefore, it is 
positive definite and we have proved the second condition on H. 

□ 


4. Numerical Simulations. Here we model a situation in which a crowd of pedes¬ 
trians is driven to leave a given square hall (whose side is 50 meters long) containing 
rectangular obstacles: one can imagine for example a situation of panic in a closed 
building, in which the population tries to reach the exit doors. The chosen geometry 
is represented on Figure [T] The aim is to compare the evolution of the density in 




Figure 1 . Left: the geometry. Right: the density at t = 0 


two models: 


1. Mean field games: we choose u = 0.012 and the Hamiltonian to be of the form 
(|3.13L i.e. which takes congestion effects into account and depends locally on 
m; more precisely: 


H{x,p, m) = 


8bP 1 

(1 -|- m)3 3200 
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2 . 


The system (jl.l0|) - (ll.ll|) becomes 


dm 

dt 


— + 0.012 Am- 

dt (1 

— 0.012 Am — 16div 



mVu \ 

(1 + m)i J 


1 

3 ^’ 


0 . 


(4.1) 

(4.2) 


The horizon T is T = 50 minutes. There is no terminal cost. 

There are two exit doors, see Figure [TJ The part of the boundary correspond¬ 
ing to the doors is called F d ■ The boundary conditions at the exit doors are 
chosen as follows: there is a Dirichlet condition for u on F^i, corresponding to 
an exit cost; in our simulations, we have chosen u = 0 on +£>. For m, we may 
assume that to = 0 outside the domain, so we also get the Dirichlet condition 
TO = 0 on Fo. 

The boundary Fjv corresponds to the solid walls of the hall and of the obsta¬ 
cles. A natural boundary condition for u on Fjv is a homogeneous Neumann 
boundary condition, i.e. = 0 which says that the velocity of the pedestri¬ 
ans is tangential to the walls. The natural condition for the density to is that 
12 ^ +to||(-, Vu,to) • n = 0, therefore ^ = 0 on F^v . 

Mean field type control: this is the situation where pedestrians or robots use 
the same feedback law (we may imagine that they follow the strategy decided 
by a leader); we keep the same Hamiltonian, and the HJB equation becomes 


Fin 

^ + 0.012 An- 
dt 


+ 


6 


(1+to)4 (1+to)4 


|V^rp = - 


3200 


(4.3) 


while (14.21) and the boundary condition are unchanged. 

The initial density toq is piecewise constant and takes two values 0 and 4 people/m^, 
see Figured] At t = 0, there are 3300 people in the hall. 

We use the finite difference method originally proposed in [3] , see [1] for some details 
on the implementation and [2] for convergence results. 

On Figured] we plot the density to obtained by the simulations for the two models, 
at t = 1, 2, 5 and 15 minutes. With both models, we see that the pedestrians rush 
towards the narrow corridors leading to the exits, at the left and right sides of the 
hall, and that the density reaches high values at the intersections of corridors; then 
congestion effects explain why the velocity is low (the gradient of u) in the regions 
where the density is high. On the figure, we see that the mean field type control 
leads to a slower exit of the hall, with lower peaks of density. 
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Figure 2. The density computed with the two models at different 
dates. Left: Mean field game. Right: Mean field type control. The 
scales vary from one date to the other 



























